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Amendments to the Claims: 

This listing of claims will replace all prior versions and listings of claims in the application. 
Listing of Claims: 

Listing of Claims: 

1-40 (Cancelled) 

41 . (Currently Amended) A system for electronically providing performance 
feedback based upon a comparison of a r e solv e r f s an evaluator's performance in evaluating data 
items to predetermined performance criteria, the system comprising: 

a) a receiving subsystem configured to electronically receive information over a 
distributed computer network related to a first performance level of a first resolv e r's evaluator's 
evaluation of data items, and a predetermined performance level; 

b) a comparison subsystem configured to electronically compare the first performance 
level and the predetermined performance level; and 

c) a discrepancy subsystem configured to electronically report a discrepancy based on 
predefined criteria between the first performance level and the predetermined performance level. 

42. (Currently Amended) The system of claim 41 wherein the discrepancy subsystem 
is further configured to electronically report the discrepancy to the first r e solv e r evaluator over a 
distributed computer network. 

43. (Previously Presented) The system of claim 41 wherein the discrepancy 
subsystem is further configured to electronically report the discrepancy to a system manager over 
a distributed computer network. 

44. (Currently Amended) A system for electronically providing performance 
feedback based upon a comparison of a r e solv e r's an evaluator's performance in evaluating data 
items to predetermined performance criteria, the system comprising: 
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a) a receiving subsystem configured to electronically receive information over a 
distributed computer network related to a first validity level of a first r e solv e r's evaluator's 
evaluation of data items, and a predetermined validity level; 

b) a comparison subsystem configured to electronically compare the first validity level 
and the predetermined validity level; and 

c) a discrepancy subsystem configured to electronically report a discrepancy based on 
predefined criteria between the first validity level and the predetermined validity level 

45. (Currently Amended) The system of claim 44 wherein the receiving subsystem is 
further configured to receive an evaluation result for a quality item from the first resolver 
evaluator over a distributed computer network and a known evaluation result for the quality item. 

46. (Currently Amended) The system of claim 44 wherein the discrepancy subsystem 
is further configured to electronically report the discrepancy to the first r e solv e r evaluator over a 
distributed computer network. 

47. (Previously Presented) The system of claim 44 wherein the discrepancy 
subsystem is further configured to electronically report the discrepancy to a system manager over 
a distributed computer network. 

48. (Currently Amended) A system for electronically providing performance 
feedback based upon a comparison of a r e solv e r's an evaluator's performance in evaluating data 
items to predetermined performance criteria, the system comprising: 

a) a receiving subsystem configured to electronically receive information over a 
distributed computer network related to a first reliability level of a first r e solv e r's evaluator's 
evaluation of data items, and a predetermined reliability level; 

b) a comparison subsystem configured to electronically compare the first reliability level 
and the predetermined reliability level; and 

c) a discrepancy subsystem configured to electronically report over a distributed 
computer network a discrepancy based on predefined criteria between the first reliability level 
and the predetermined reliability level. 



5 



Appl No. 10/690,488 

Amdt. dated May 13, 2004 

Reply to Office Action of April 6, 2004 

49. (Currently Amended) The system of claim 48 wherein the receiving subsystem is 
further configured to receive a first evaluation result corresponding to the first r e solv e r f s 
evaluator's evaluating of a data item during a first time period and to receive a second evaluation 
result corresponding to the first resolv e r's evaluator's evaluation of the data item during a second 
time period. 

50. (Currently Amended) The system of claim 48 wherein the discrepancy subsystem 
is further configured to electronically report the discrepancy to the first r e solv e r evaluator over a 
distributed computer network. 

5 1 . (Previously Presented) The system of claim 48 wherein the discrepancy 
subsystem is further configured to electronically report the discrepancy to a system manager over 
a distributed computer network. 

52. (Currently Amended) A system for electronically providing performance 
feedback based upon a comparison of a r e solv e r's an evaluator's performance in evaluating data 
items to predetermined performance criteria, the system comprising: 

a) a receiving subsystem configured to electronically receive information over a 
distributed computer network related to a first speed level of a first r e solv e r's evaluator's 
evaluating of data items, and a predetermined speed level; 

b) a comparison subsystem configured to electronically compare the first speed level and 
the predetermined speed level; and 

c) a discrepancy subsystem configured to electronically report a discrepancy over a 
distributed computer network based on predefined criteria between the first speed level and the 
predetermined speed level. 

53. (Currently Amended) The system of claim 52 wherein the receiving subsystem is 
further configured to receive at least one of the following: a first evaluating rate corresponding to 
the first r e solv e r's evaluator's evaluating of the data items, an average evaluating rate 
corresponding to a selected group of resolv e rs' evaluators 1 evaluating of the data items, and a 
second evaluating rate corresponding to a second r e solv e r's evaluator's evaluating of the data 
items. 
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54. (Currently Amended) The system of claim 53 wherein the discrepancy subsystem 
is further configured to electronically report the discrepancy to the first r e solv e r evaluator over a 
distributed computer network. 

55. (Previously Presented) The system of claim 53 wherein the discrepancy 
subsystem is further configured to electronically report the discrepancy to a system manager over 
a distributed computer network. 

56. (Currently Amended) A system for increasing r e solv e r evaluator efficiency by 
monitoring r e solv e r evaluator performance in evaluating data items and recommending break 
times to the r e solv e rs evaluators , the system comprising: 

a) receiving subsystem configured to electronically receive first performance levels over 
a distributed computer network corresponding to a r e solv e r's an evaluator f s evaluating of data 
items at predetermined past intervals in time, and electronically receiving over a distributed 
computer network a second predetermined performance level; 

b) a comparison subsystem configured to electronically compare the second 
predetermined performance level and the first performance level; and 

c) a discrepancy subsystem configured to electronically detect a discrepancy based on 
predefined criteria between the second predetermined performance level and the first 
performance level and signaling the r es olv e r evaluator to halt data item evaluating for a break 
time. 

57. (Currently Amended) The system of claim 56 wherein the receiving subsystem is 
further configured to electronically receive first validity levels from the r e solv e r evaluator over a 
distributed computer network and to electronically receive a second predetermined validity level 
over a distributed computer network. 

58. (Currently Amended) The system of claim 56 wherein the receiving subsystem is 
further configured to electronically receive first reliability levels from the r e solv e r evaluator over 
a distributed computer network and to electronically receive a second predetermined reliability 
level over a distributed computer network. 
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59. (Currently Amended) The system of claim 56 wherein the subsystem is further 
configured to electronically receive first speed levels from the r e solver evaluator over a 
distributed computer network and to electronically receive a second predetermined speed level 
over a distributed computer network. 

60. (Currently Amended) The system of claim 56 wherein the discrepancy subsystem 
is further configured to electronically detect a discrepancy based on predefined criteria between 
the second predetermined performance level and the first performance levels and providing the 
r e solv e r evaluator with diversionary activities over a distributed computer network. 

61 . (Currently Amended) The system of claim 56 wherein the discrepancy subsystem 
is further configured to enable the resolv e r evaluator to select diversionary activities over a 
distributed computer network when the r e solv e r evaluator is signaled for the break time. 

62. (Currently Amended) A system for increasing r e solver evaluator efficiency by 
monitoring r e solv e r evaluator performance in evaluating data items and recommending break 
times to the r e solver evaluator , the system comprising: 

a) a receiving subsystem configured to electronically receive first evaluation rates 
corresponding to a r e solv e r's an evaluator's evaluating of data items at predetermined past 
intervals in time, and electronically receive a second present evaluation rate corresponding to the 
r e solv e r's evaluator's evaluating of the data items at a present time; 

b) a comparison subsystem configured to electronically compare the second evaluation 
rate and the first evaluation rate; and 

c) a discrepancy subsystem configured to electronically detect a discrepancy based on 
predefined criteria between the second evaluation rate and the first evaluation rate as indicated 
by the comparison subsystem and signal over the distributed computer network the r e solver 
evaluator to halt data item evaluation for a break time. 

63. (Currently Amended) The system of claim 62 wherein the discrepancy subsystem 
is further configured to electronically detect a discrepancy based on predefined criteria between 
the second present evaluation rate and the first evaluation rate as indicated by the comparison 
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subsystem and provide the r e solv e r evaluator with diversionary activities over the distributed 
computer network. 

64. (Currently Amended) The system of claim 62 wherein the discrepancy subsystem 
is further configured to enable the r e solv e r evaluator to select diversionary activities over the 
distributed network when the resolv e r evaluator has been signaled for the break time. 

65. (Currently Amended) A computer-readable program storage medium tangibly 
embodying a data package and associated verification instructions executable by a computing 
system for electronically providing performance feedback based upon a comparison of a 
r e solv e r f s an evaluator's performance in evaluating data items to predetermined performance 
criteria, the method comprising the steps of: 

a) electronically receiving information related to a first performance level of a first 
r e solv e r's evaluator's evaluation of data items, and a predetermined performance level; 

b) electronically comparing the first performance level and the predetermined 
performance level; and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
performance level and the predetermined performance level. 

66. (Currently Amended) The computer-readable program storage medium of claim 
65 wherein the step of electronically reporting a discrepancy comprises electronically reporting 
the discrepancy to the first resolv e r evaluator . 

67. (Previously Presented) The computer-readable program storage medium of claim 
65 wherein the step of electronically reporting a discrepancy comprises electronically reporting 
the discrepancy to a system manager. 

68. (Currently Amended) A computer-readable program storage medium tangibly 
embodying a data package and associated verification instructions executable by a computing 
system for electronically providing performance feedback based upon a comparison of a 
r e solv e r's an evaluator's performance in scoring data items to predetermined performance 
criteria, the method comprising the steps of: 
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a) electronically receiving information related to a first validity level of a first resolvor ! G 
evaluator's evaluation of data items, and a predetermined validity level; 

b) electronically comparing the first validity level and the predetermined validity level; 

and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
validity level and the predetermined validity level. 

69. (Currently Amended) The computer-readable program storage medium of claim 
68 wherein the step of electronically receiving information comprises receiving an evaluation 
result for a quality item from the first r e solv e r evaluator and a known score for the quality item. 

70. (Currently Amended) The computer-readable program storage medium of claim 
68 wherein the step of electronically reporting a discrepancy comprises electronically reporting 
the discrepancy to the first r e solv e r evaluator . 

71 . (Previously Presented) The computer-readable program storage medium of claim 
68 wherein the step of electronically reporting a discrepancy comprises electronically reporting 
the discrepancy to a system manager. 

72. (Currently Amended) A computer-readable program storage medium tangibly 
embodying a data package and associated verification instructions executable by a computing 
system for electronically providing performance feedback based upon a comparison of a 
r es olv e r's an evaluator's performance in evaluating data items to predetermined performance 
criteria, the method comprising the steps of: 

a) electronically receiving information related to a first reliability level of a first resolv e r's 
evaluator's evaluation of data items, and a predetermined reliability level; 

b) electronically comparing the first reliability level and the predetermined reliability 
level; and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
reliability level and the predetermined reliability level. 

73. (Currently Amended) The computer-readable program storage medium of claim 
72 wherein the step of electronically receiving information comprises receiving a first evaluation 
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result corresponding to the first resolv e r's evaluator's evaluation of a data item during a first time 
period and for receiving a second evaluation result corresponding to the first r e solv e r's 
evaluator's evaluation of the data item during a second time period. 

74. (Currently Amended) The computer-readable program storage medium of claim 
72 wherein the step of electronically reporting a discrepancy comprises electronically reporting 
the discrepancy to the first r e solver evaluator . 

75. (Previously Presented) The computer-readable program storage medium of 
claim 72 wherein the step of electronically reporting a discrepancy comprises electronically 
reporting the discrepancy to a system manager. 

76. (Currently Amended) A computer-readable program storage medium tangibly 
embodying a data package and associated verification instructions executable by a computing 
system for electronically providing performance feedback based upon a comparison of a 
r e solv e r's an evaluator's performance in evaluation of data items to predetermined performance 
criteria, the method comprising the steps of: 

a) electronically receiving information related to a first speed level of a first r e solv e r's 
evaluator's evaluation of data items, and a predetermined speed level; 

b) electronically comparing the first speed level and the predetermined speed level; and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
speed level and the predetermined speed level. 

77. (Currently Amended) The computer-readable program storage medium of claim 
76 wherein the step of electronically receiving information comprises receiving at least one of 
the following: a first evaluation rate corresponding to the first r e solv e r's evaluator's evaluation of 
the data items, an average evaluation rate corresponding to a selected group of r e solv e rs' 
evaluators' evaluation of the data items, and a second evaluation rate corresponding to a second 
r e solv e r's evaluator's evaluation of the data items. 
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78. (Currently Amended) The computer-readable program storage medium of claim 
76 wherein the step of electronically reporting a discrepancy comprises electronically reporting 
the discrepancy to the first r e solv e r evaluator . 

79. (Previously Presented) The computer-readable program storage medium of 
claim 76 wherein the step of electronically reporting a discrepancy comprises electronically 
reporting the discrepancy to a system manager. 

80. (Currently Amended) A computer-readable program storage medium tangibly 
embodying a data package and associated verification instructions executable by a computing 
system for increasing r e solver evaluator efficiency by monitoring r e solv e r evaluator performance 
in evaluating data items and recommending break times to the r e solv e rs evaluator, the method 
comprising the steps of: 

a) electronically receiving first performance levels corresponding to a r e solv e r's an 
evaluator f s evaluation of data items at predetermined past intervals in time, and electronically 
receiving a second predetermined performance level; 

b) electronically comparing the second predetermined performance level and the first 
performance level; and 

c) electronically detecting a discrepancy based on predefined criteria between the second 
predetermined performance level and the first performance level and signaling the r e solv e r 
evaluator to halt data item evaluation for a break time. 

81. (Currently Amended) The computer-readable program storage medium of claim 
80 wherein the step of electronically receiving first performance levels comprises electronically 
receiving first validity levels from the r e solv e r evaluator and electronically receiving a second 
predetermined validity level. 

82. (Currently Amended) The computer-readable program storage medium of claim 
80 wherein the step of electronically receiving first performance levels comprises electronically 
receiving first reliability levels from the resolver evaluator and electronically receiving a second 
predetermined reliability level. 
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83. (Currently Amended) The computer-readable program storage medium of claim 
80 wherein the step of electronically receiving first performance levels comprises electronically 
receiving first speed levels from the r e solv e r evaluator and electronically receiving a second 
predetermined speed level. 

84. (Currently Amended) The computer-readable program storage medium of claim 
80 wherein the step of electronically detecting a discrepancy comprises electronically detecting a 
discrepancy based on predefined criteria between the second predetermined performance level 
and the first performance levels and providing the r e solver evaluator with diversionary activities. 

85. (Currently Amended) The computer-readable program storage medium of claim 
80 wherein the step of electronically detecting a discrepancy comprises enabling the r e solv e r 
evaluator to select diversionary activities when the r e solv e r evaluator is signaled for the break 
time. 

86. (Currently Amended) A computer-readable program storage medium tangibly 
embodying a data package and associated verification instructions executable by a computing 
system for increasing r e solv e r evaluator efficiency by monitoring r e solv e r evaluator performance 
in evaluating data items and recommending break times to the r e solv e rs evaluators , the method 
comprising the steps of: 

a) electronically receiving a first evaluation rate first e valuation rat e s corresponding to a 
r e solv e r's an evaluator ! s evaluating of data items at predetermined past intervals in time, and 
electronically receiving a second present evaluation rate corresponding to the resolv e r's 
evaluator's scoring of the data items at a present time; 

b) electronically comparing the second evaluation seormg rate and the first evaluation 
scoring rate; and 

c) electronically detecting a discrepancy based on predefined criteria between the second 
evaluation rate and the first evaluation rate as indicated by the comparison step and signaling the 
r e solv e r evaluator to halt data item evaluation for a break time. 

87. (Currently Amended) The computer-readable program storage medium of claim 
86 wherein the step of electronically detecting a discrepancy further comprises electronically 
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detecting a discrepancy based on predefined criteria between the second present evaluation rate 
and the first evaluation rate as indicated by the comparison step and providing the r e solver 
evaluator with diversionary activities. 

88. (Currently Amended) The computer-readable program storage medium of claim 
86 wherein the step of electronically detecting a discrepancy further comprises enabling the 
r e solv e r evaluator to select diversionary activities when the r e solv e r evaluator has been signaled 
for the break time. 

89. (Currently Amended) A method for electronically providing performance 
feedback based upon a comparison of a resolv e r's an evaluator's performance in evaluating data 
items to predetermined performance criteria, the method comprising the steps of: 

a) electronically receiving information related to a first performance level of a first 
r e solv e r's evaluator's evaluation of data items, and a predetermined performance level; 

b) electronically comparing the first performance level and the predetermined 
performance level; and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
performance level and the predetermined performance level. 

90. (Currently Amended) The method of claim 89 wherein the step of electronically 
reporting a discrepancy comprises electronically reporting the discrepancy to the first r e solv e r 
evaluator . 

91 . (Previously Presented) The method of claim 89 wherein the step of electronically 
reporting a discrepancy comprises electronically reporting the discrepancy to a system manager. 

92. (Currently Amended) A method for electronically providing performance 
feedback based upon a comparison of a r e solv e r's an evaluator's performance in scoring data 
items to predetermined performance criteria, the method comprising the steps of: 

a) electronically receiving information related to a first validity level of a first r e solv e r's 
evaluator's evaluation of data items, and a predetermined validity level; 
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b) electronically comparing the first validity level and the predetermined validity level; 

and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
validity level and the predetermined validity level. 

93. (Currently Amended) The method of claim 92 wherein the step of electronically 
receiving information comprises receiving an evaluation result for a quality item from the first 
r e solv e r evaluator and a known score for the quality item. 

94. (Currently Amended) The method of claim 92 wherein the step of electronically 
reporting a discrepancy comprises electronically reporting the discrepancy to the first resolv e r 
evaluator . 

95. (Previously Presented) The method of claim 92 wherein the step of electronically 
reporting a discrepancy comprises electronically reporting the discrepancy to a system manager. 

96. (Currently Amended) A method for electronically providing performance 
feedback based upon a comparison of a r e solv e r f s an evaluator's performance in evaluating data 
items to predetermined performance criteria, the method comprising the steps of: 

a) electronically receiving information related to a first reliability level of a first r e solv e r ? s 
evaluator's evaluation of data items, and a predetermined reliability level; 

b) electronically comparing the first reliability level and the predetermined reliability 
level; and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
reliability level and the predetermined reliability level. 

97. (Currently Amended) The method of claim 96 wherein the step of electronically 
receiving information comprises receiving a first evaluation result corresponding to the first 
r e solv e r's evaluator's evaluation of a data item during a first time period and for receiving a 
second evaluation result corresponding to the first r e solv e r's evaluator's evaluation of the data 
item during a second time period. 
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98. (Currently Amended) The method of claim 96 wherein the step of electronically 
reporting a discrepancy comprises electronically reporting the discrepancy to the first r e solv e r 
evaluator . 

99. (Previously Presented) The method of claim 96 wherein the step of 
electronically reporting a discrepancy comprises electronically reporting the discrepancy to a 
system manager. 

100. (Currently Amended) A method for electronically providing performance 
feedback based upon a comparison of a resolver's an evaluator's performance in evaluation of 
data items to predetermined performance criteria, the method comprising the steps of: 

a) electronically receiving information related to a first speed level of a first r e solv e r's 
evaluator's evaluation of data items, and a predetermined speed level; 

b) electronically comparing the first speed level and the predetermined speed level; and 

c) electronically reporting a discrepancy based on predefined criteria between the first 
speed level and the predetermined speed level. 

101. (Currently Amended) The method of claim 1 00 wherein the step of electronically 
receiving information comprises receiving at least one of the following: a first evaluation rate 
corresponding to the first r e solv e r's evaluator's evaluation of the data items, an average 
evaluation rate corresponding to a selected group of resolvers' evaluators' evaluation of the data 
items, and a second evaluation rate corresponding to a second r e solv e r's evaluator's evaluation of 
the data items. 

102. (Currently Amended) The method of claim 100 wherein the step of electronically 
reporting a discrepancy comprises electronically reporting the discrepancy to the first r e solv e r 
evaluator . 

103. (Previously Presented) The method of claim 100 wherein the step of 
electronically reporting a discrepancy comprises electronically reporting the discrepancy to a 
system manager. 
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104. (Currently Amended) A method for increasing resolv e r evaluator efficiency by 
monitoring r e solv e r evaluator performance in evaluating data items and recommending break 
times to the r e solv e rs evaluator s, the method comprising the steps of: 

a) electronically receiving first performance levels corresponding to a resolv e r f s an 
evaluator's evaluation of data items at predetermined past intervals in time, and electronically 
receiving a second predetermined performance level; 

b) electronically comparing the second predetermined performance level and the first 
performance level; and 

c) electronically detecting a discrepancy based on predefined criteria between the second 
predetermined performance level and the first performance level and signaling the r e solv e r 
evaluator to halt data item evaluation for a break time. 

105. (Currently Amended) The method of claim 104 wherein the step of electronically 
receiving first performance levels comprises electronically receiving first validity levels from the 
r e solv e r evaluator and electronically receiving a second predetermined validity level. 

106. (Currently Amended) The method of claim 1 04 wherein the step of electronically 
receiving first performance levels comprises electronically receiving first reliability levels from 
the r e solv e r evaluator and electronically receiving a second predetermined reliability level. 

107. (Currently Amended) The method of claim 104 wherein the step of electronically 
receiving first performance levels comprises electronically receiving first speed levels from the 
r e solv e r evaluator and electronically receiving a second predetermined speed level. 

108. (Currently Amended) The method of claim 104 wherein the step of electronically 
detecting a discrepancy comprises electronically detecting a discrepancy based on predefined 
criteria between the second predetermined performance level and the first performance levels 
and providing the r e solv e r evaluator with diversionary activities. 

109. (Currently Amended) The method of claim 104 wherein the step of electronically 
detecting a discrepancy comprises enabling the r e solv e r evaluator to select diversionary activities 
when the r e solver evaluator is signaled for the break time. 
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1 10. (Currently Amended) A method for increasing resolv e r evaluator efficiency by 
monitoring r e solv e r evaluator performance in evaluating data items and recommending break 
times to the r e solvers evaluators , the method comprising the steps of: 

a) electronically receiving first e valuation rates a first evaluation rate corresponding to a 
r e solv e r's an evaluator's evaluating of data items at predetermined past intervals in time, and 
electronically receiving a second present evaluation rate corresponding to the r e solv e r's 
evaluator's scoring of the data items at a present time; 

b) electronically comparing the second scoring evaluation rate and the first scoring 
evaluation rate; and 

c) electronically detecting a discrepancy based on predefined criteria between the second 
evaluation rate and the first evaluation rate as indicated by the comparison step and signaling the 
r e solv e r evaluator to halt data item evaluation for a break time. 

111. (Currently Amended) The method of claim 1 10 wherein the step of electronically 
detecting a discrepancy further comprises electronically detecting a discrepancy based on 
predefined criteria between the second present evaluation rate and the first evaluation rate as 
indicated by the comparison step and providing the r e solver evaluator with diversionary 
activities. 

112. (Currently Amended) The method of claim 110 wherein the step of electronically 
detecting a discrepancy further comprises enabling the resolv e r evaluator to select diversionary 
activities when the r e solv e r evaluator has been signaled for the break time. 
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